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Abstract 

We introduce a method for computing corrections to Bethe approximation for spin 
models on arbitrary lattices. Unlike cluster variational methods, the new approach 
takes into account fluctuations on all length scales. 

The derivation of the leading correction is explained and applied to two simple 
examples: the ferromagnetic Ising model on d-dimensional lattices, and the spin glass 
on random graphs (both in their high-temperature phases). In the first case we 
rederive the well-known Ginzburg criterion and the upper critical dimension. In the 
second, we compute finite-size corrections to the free energy. 
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1 Introduction 



Mean field approximations are the among the most frequently used tools in Statistical 
Physics. Among them, Bethe approximation (BA) [1] allows to treat with reasonable 
accuracy a large variety of lattice models. Recently it has been successfully applied 
(in an algorithmic form) to problems of inference [2-4] , communications [5] , and com- 
binatorial optimization [6]. Often in these cases the underlying lattice has few or no 
short loops, and BA (which is exact on trees) can become exact in the thermodynamic 
limit. 

BA can be systematically improved using Kikuchi [7] or cluster variational meth- 
ods (CVM). These approaches take into account 'exactly' of correlations up to some 
finite range r and their complexity grows exponentially with r. Because of this fea- 
ture, they are unsuited for understanding the effect of long length scale fluctuations. 
Furthermore, in lattices without short loops, no improvement is obtained unless r is 
very large (which is of course unfeasible). 

For models on d-dimensional lattices, mean field can be also regarded as the zeroth 
order term in a 1/d expansion.^ Such an expansion is however close in spirit to CVM, 
in that it keeps into account only the effect of short loops in the lattice [8] . 

In the field-theoretical setting [9,10], mean field approximation is usually derived 
by retaining only tree- level Feynman diagrams. The usual loop expansion improves 
systematically over such an approximation by taking into account of fluctuations 
on all length scales order- by-order in a properly deflned coupling parameter. When 
resummed using renormalization-group ideas, it gives an accurate description of many 
critical phenomena. 

Often a simple (and correct) field-theoretical formulation of the problem is hard to 
derive. This is the case, for instance, of problems with quenched disorder, where one 
usually invoke the replica trick for averaging over the disorder [10]. Also, field theo- 
retical methods are usually unreliable for computing non- universal quantities. These 
can be on the other hand important for some of the applications (inference, commu- 
nications, optimization) mentioned above. In this paper we present an approach for 
computing corrections to BA coming from fiuctuations on all length scales. 

To be concrete, we shall focus on spin models with pairwise interactions on general 
graphs, with Hamiltonian 



Here Q = {V,£) is a graph with vertex set V = {1,...,A^} and edges £ 3 
£ C V X V. The set of neighbors of the site i is noted di. We shall use the letters 
a,b,. . . to denote generic edges, and, whenever necessary write {ia,ja) = a- Finally, 
for any set of vertices A £ V, cta = {ai : i G A}. Several families of graphs and 
choices of the couplings Jij, Hi will be considered in Section IHl but for the time being 
we shall remain completely general. 

The Bethe approximation for such a model [11] is better described by introducing 

(7) 

a field hf for each directed link i j oi Q. Such fields are required to satisfy the 
Generally, B A takes into account exactly also the first 1/d correction. 
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equations 



h'f^ =Hi+ J2 '^J^j (hf) ' ^ = \ atanh[tanh(/3J) tanh(/5/i)] . (1.2) 

i(idi\j ^ 

(i) 

Once a solution of these equations is found, one can use the fields h - to estimate the 
thermal average of local operators. For instance 



(a.) ^1^=^^ -1 ^ a exp(/3ff.a) n \ , «- , (1-3) 

^^t^x /J,2cosh(/3n(J,„/i«)) 



Wi 



E -MPH.cr) n (.) • (1.4) 

a=±i ji^di 2cosh(/3n(Jij, h\ ')) 



The basic approximation involved in derived these equations is the following. Consider 
a spin (Tj and set its interaction with the neighbors to 0: Jij = for all j E di (in other 
words cjj is 'removed' from the system). Now look at the joint probability distribution 
of the neighboring spins cjgj in the system without cTj. Bethe approximation amount 
to saying that 

j^Oi 2 cosh (3hy 

Our approach consists in deriving a set of exact equations for the 'cavity' distributions 
Pj( • )'s. When the form H1.5|) is plugged in these equations, the Bethe equations <\l.'2\i 
are derived. Corrections are computed by introducing correlations in Pi{agi). 

In Section [21 we shall explain the general method for computing corrections to 
BA. We then use it in Section El for computing the leading corrections to BA for two 
particular examples: the ferromagnet on cubic d-dimensional lattices and the spin 
glass on random graphs. 



2 The general approach 

In order to explain the general computation scheme, it is convenient to introduce some 
notation. We denote by E^^^ (a) a modified energy function in which the interactions 
between the spin i and its neighbors have been canceled. Analogously, E^"'\a), with 
a £ S, is the energy function modified by eliminating the interaction along the edge 
a. In formulae: 

E^^\a) = E{a) + ^ ,h,a,a, , E^'^^a) = E{a) + J.„,„a,,a,, . (2.1) 

jedi 

We denote by ( • )^*'' and ( • )^"^ the Boltzmann averages with respect to these modified 
energy functions. As in the introduction, Pi{aQi) the marginal distribution of the 
neighbors of i with respect to the system with energy E^^\a). Analogously, we define 
the distribution Paicri^,aj^). 
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Figure 1: The magnetizations at site and 1 in the absence of hnk Jio can be expressed 
in term of the correlations of the spins 0, 4, 5 in the absence of spin 1 or of the correlations 
between spins 1,2,3 in the absence of spin 0, the equality of the results yields the cavity 
equations. 

In order to have a concrete representation for the distributions Pi^agi), we shall 
use the correlation functions 

c'i^ = (H ^i)^^^ =T.p^(^9^) n ■ (2-2) 

for any non-empty subset A G di. In the special case A = {j} we shall also use the 
more conventional notation Afj*^ = C^*^- In Bethe approximation, the distribution 
Pi{o'Qi) is assumed to be factorized, cf. Eq. H1.5() . In order to compute corrections, 

(i) 

it is convenient to introduce the connected correlation functions Cy . We have the 
usual relation 

C^^= E (2-3) 
[Ai...A„] 

with [^1, ...,A n\ running over the partitions of A. Finally C^*) = {c'^ : A C di}. 

Let us now derive the basic relation between the Pi(-)'s to be exploited in the 
following. Consider two sites i and j which are joined by an edge in Q. We can 
construct the distribution P(^ij^{ai,aj) in two ways: 

Piij){o-i,(^j) = Pji^dj) exp^PHjaj + (3 ^ Jjicrjcri] , (2.4) 

^ '^dj\i ledj\i 

and the equivalent one (let us call Plj{ai,aj) the corresponding expression) which is 
obtained by interchanging i and j. Here Zj is a constant which ensures the correct 
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normalization of P(ij) {c^i We can now marginalize the right hand side of Eq. (|2^ 
with respect to Uj (to a-i) in order to compute the magnetizations on site i (site j) 
with respect to the system with energy function (a). The same calculation can be 
performed using the expression P'^.j^(ai,aj). Since the result of these two calculations 
must be the same, we obtain two equations of the form: 

bW(C'W) = K\^\c^j)) , KfiC'^'^) = b\^\c'^^^) . (2.5) 

The function B^*^( • ) yields the magnetization at site j when the distribution Pi{(Jdi) 

is modified through the addition of the interactions Ju, I / j. Analogously, Kj*^( • ) 
yields the magnetization at site i for the same system. Elementary algebraic manip- 
ulations yields the explicit expressions: 

Yj ^aCauj + t{Hi) J2 ^aCauj 

B^'\C) = =^ . ^ = , (2.6) 

' E tACA + tmEtACA 

JA even .A odd 

tm Z tACA + E tACA 

K^^VC) ^cvcn .Aodd /2 ij\ 

' E tACA + tmZtACA ' 

A even .A odd 

where the sums over A run over all the subsets of neighbors i, A (z di, which do not 
include j. Furthermore, we used the shorthands = Hieyt**'' = tanh(/3 Jj^) and 
t{Hi) = tanh(/3i?j). The above functions can be written in terms of the connected 
correlations by using the relation 1)2. 3(1 . 

Consider for instance the case depicted in Fig. ^ where i = and j = 1 have both 
degree 3. We furthermore assume, for the sake of simplicity, Hq = Hi = 0. Then 

rM i\Ao) ^(0) , .(0) ^(0) 
b(0)(^(0)) ^ +to.to3 "^^^^^3 +^^^3,^ , (2.8) 

1 + ^02*03 ^2 -^3 + ^02*03^^23 
1 + ^02^03 ^2'^'* ^3'^'* + *02i03C'2? 

The analogous expressions for Bq^^(C^^'') and Kq^^(C^^'') are obtained by interchanging 
<-> 1 and {2,3} <-> {4,5}. It is therefore easy to write explicitly the equation 
B('HcW)=Kf)(C(0)): 

Mq + lulls 



1 + tMtisMi'^M^') + tuh^C^^ 1 + to2to3Mf + io2to3Cg^ ■ 

There are 2\£\ equations of the form 1)2. 5() : one for each directed link in the 
graph. The number of unknowns is, on the other hand EjC^''^*' ~ 1)' with the sum 
running over the sites of the graph, and \di\ being their connectivity. Therefore, 
these equations are not sufficient to determine the correlation functions C^*^. If, on 
the other hand, we neglect multi-spin connected correlation functions and only retain 
the cavity magnetizations Afj*^ (as in Bethe approximation), we are left with 2\£\ 
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variables to determine. In this case Eqs. (|2.6|) and (|2.7)) are considerably simplified: 



j 



Bethe 



By setting Mj'' = ta,nh.ph^j \ it is easy to see that the equations (|2.5|) are in this 
case the Bethe equations^ ()1.2() . If, for instance, Q is a tree, the connected cavity 
correlations C^^ vanish if |^| > 2. We thus proved recovered the well-known result 
that Bethe approximation is exact on tree graphs. 

We want now to estimate the connected cavity correlations , for \A\ > 2, and 

then use Eq. ()2.5() to improve the calculation of Mj^\ In synthesis, the correlations 
are estimated through the fluctuation-dissipation theorem: 

1 5"Mi, 



tanh < 



(3 Hi + atanh 

k£di\j 



UkM, 



(2.10) 



(2.11) 



(2.12) 



dHi, 

where ii . . -in+i are n + 1 distinct index sites. Here Mi and are magneti- 

zations and correlations with respect to an arbitrary Hamiltonian of the form l|l.l() . 
In other terms, one can obtain equations for the correlations by taking appropriate 
derivatives of the exact equations (|2.5j) with respect to an external field. ^ 

For, the sake of clarity, let us compute the leading-order correction to BA. We 
neglect all connected cavity correlation functions with \A\ > 3. Moreover, we 
treat two point correlation functions to the linear order. To this order, the expressions 
((T^ and (fTTj) become 



B 



M, 



iedi\j 
(/i,/2)G9Ai 



where 



^1,1 



1 + tiM^T^^ 



r 



(0 



(0 



p(0 
j 



Ai)rp{i) 



Ai)rp{i) 



and 



tanh < 



mi+ 



atanh 



(2.13) 
(2.14) 

(2.15) 
(2.16) 

(2.17) 



kGdi\li,l2- 



^This derivation of BA is in fact mentioned as a side remark in Rcf. [12]. 

■^One can see that the differentiation procedure is well-defined through the following (numerically im- 
precise but conceptually simple) implementation. Compute the magnetization Mi, then change slightly the 
external field on site j, Hj —>■ Hj + 5Hj, and evaluate the correlation function between sites i and j as 
Cij = VnnsHj^oiSMi/ pSHj). Higher-order correlations are computed analogously by considering variations 
of the external fields at several points. 
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We can therefore proceed as follows. First solve the Bethe equations for the 

original energy function Hl.lj) . Then, for each site i £ V, consider the energy function 
E^^\a) corresponding to the spin ai being removed. Compute the two point con- 

(i) 

nected correlation functions in the reduced system C'jjjj ^si'^S BA together with the 
fluctuation-dissipation relations (|2.12|) . Finally write 

Mf = tanh(/?/i5'^) + AM^ + 0{C^) . (2.18) 

The first order corrections AM^*^ are computed by expanding the equations (|2.5() up 
to first order in C. Using the expansion (|2.1l-{j) . (|2.1l-{j) . we get 

AMf+ ^ t^cf= QS5AMi^)+ r!l,t,,t,,cg) . (2.19) 

l&di\j kedj\i (.h,l2)&dj\i 

where 

l-itjktanh{ph)^>))^ 

(i) (?) 

Here the coefficients ilj [ and F^ 1^^^ are computed through Eqs (|2.15|) and (|2.16|) by 
setting M^'^ tanh(/3/i[,''*). We thus obtained one equation of the form 1)2. 19(1 for 

each directed edge in the lattice. These completely determine the AMj . 

It is important to stress that the above procedure is not uniquely defined. One 
could consider equivalent calculations which differ from the above by higher order 
corrections. Here are two examples: 

1. One could compute the connected cavity correlations without removing the spin 
i from the system but rather using the relation 

C« = (1 - tanh^ /3/iW) , (2.21) 

which in turns follows from Mj = tanh/3/i^- . Equations for are easily 
obtained by differentiating Eq. H1.2|) . 
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2. Instead of expanding the equations (|2.5)) to the first order in CjJ and AMj , one 
could proceed as follows. Set to zero all the correlation functions , \A\ > 3, 
replace Cj^ by their Bethe approximation, and solve for Mj . 

In particular, the last implementation is exact whenever the graph Q contains (at 
most) a unique loop (thus improving over BA). Since the equations (|2.5j) are exact, 
in order to prove this claim it is enough to show that the procedure defined above 
computes correctly the correlation functions , \A\ > 2. If \A\ > 3 and Q has a 
single loop, then Cy = 0, and the algorithm does not make any error in neglecting 

these correlations. Consider now the computation of Cj^J^ and distinguish two cases. 
In the first case, the graph obtained by removing the vertex i is a tree (as e.g. for 
site 1 in Fig. |2)). Therefore BA is exact for the energy function E^'^\cj) and correctly 
computes the correlations C'/^/j' second case upon removing site i, the resulting 

graph, let us call it Q\i, still contains a loop (as for site 2 in Fig. |2)). Notice that 
Q\i is disconnected, and each of the neighbors of i belongs to a distinct connected 
component. Therefore Cj^-^ = for any two neighbors ji, ^2 of i- While BA is not 
exact for Q\i^ it is easy to see that it correctly gives yields vanishing correlations 
among sites belonging to different connected components. 

At this point it should be clear how to improve the above first-order scheme. 
After removing the spin i, one can compute the correlations within the first 
order scheme rather than Bethe approximation (and retain three points correlation 
as well) and then recompute the magnetizations Afj*^ using Eq. I|2.5() . 

The general procedure can be explained as a recursive pseudocode. The code 
makes use of a routine CorrelationC Q, E{-), {C*-*)} ) which takes as input a 
graph Q, an Hamiltonian E{-) of the form an estimation of the n-points cavity 

correlations {C^*-*} for any i G G. The output consists of a new estimation of all 
n-points correlation functions. This is obtained (let's repeat ourselves) by a joint 
solution of Eqs. 1)2. 5() and (|2.12|) . A particular case of the routine CorrelationC • ) 
is obtained when all the multi-point cavity correlations {C^*^} are set to 0. This 
corresponds of course to BA. For the sake of clarity, we shall denote the corresponding 
routine Bethe ( Q, E(-) ) instead of CorrelationC Q, E{-) , ). 

The recursive routine, Loop(), takes as input a graph Q, an Hamiltonian of the 
form and the order of approximation i to be achieved. The output consists of 

an estimation of all n-points connected correlation functions in the system. 

LoopC g, E{-), I ) 

If (£==1) Output Bethe ( G, E{-) ) 
Else 

For (feV) := Loop( ^V, ^«(-), i-l) 
Output CorrelationC g, E{-) , {C^} ) 

End 

Let us stress that this algorithm deals with particular samples of the model, with- 
out need for an average over disorder realizations. Its complexity is (for graphs with 
bounded connectivity) 0{N^), i.e. polynomial for any fixed £. This makes its appli- 
cation to inference/optimization problems a viable research direction. The algorithm 
implements the strategy 2 above (actual elimination of a site): arguing as above, it 



8 



can be proved that by induction that Loop( •, ■, i ) is exact on graphs with cyclic 
number not larger than I. 



3 Applications 

In this Section we apply the method developed so far to two simple problems: the 
spin glass on random graphs with general connectivity distributions, and the ferro- 
magnetic Ising model on the cubic d-dimensional lattice. In both examples we will 
keep ourselves to the high temperature, no external field phase. The precise nature 
of the corrections computed within our approach is different for these two applica- 
tions. In the first case, they correspond to higher orders in the loop expansion. While 
there is no formal parameter to order the loop expansion for the Ising model on cubic 
lattices, we are able to recover the well known Ginzburg criterion and the associated 
one-loop integral. In the second one, successive terms in our expansion correspond to 
higher powers in (A^ being the number of spins). 



3.1 Ising model on the cubic lattice 

We take Q to be the d-dimensional cubic lattice, i.e. with edges joining neighboring 
vertices. Vertices of the lattices will be denoted in this Section by x, y, z, • • • G Z'^, 
while unit vectors by /i, i^, • • • G {(1, 0, . . . ), (0, 1, . . . ), . . . }. We consider the usual 
Ising ferromagnet, i.e. Jxy = 1 and = H. 

Because of translational invariance, the Bethe equations admit an uniform solution 

(x) 

hy = h, with h solving 

h = H + atanh[tanh (5 tanh (3h]. (3.1) 

Analogously, the cavity magnetizations do not depend on the site: Afj'^ = M'^^^ , and 
we have M*^*^"^ = tanh/3/i-|- AM'^'^^ + 0(C^). In order to write the results in a compact 
form, it is convenient to introduce the field 

P 

hp = H + — atanh[tanh /? tanh f3h] . (3-2) 

We shall furthermore use the shorthand t = tanh /?. After some tedious but straight- 
forward calculations, Eq. (|2.19|) yields 

AM-- = -^^C(5, (3.3) 



B 



where 



1 t tanh /3/i2d-2 d — 1 2t^ tanh ph 

d (l + ttanh/?/itanh/3/i2d_2)(l -tanh2/?/i) d l-t^tanli^ph 



B = ^ (2d-l) — 5 . (3.5) 

1 - tanh^ ph 1 - t2 tanh^ ph 
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Using these expressions, we can compute the (non-cavity) magnetization M = {cTx) 
M = Mo + MiY.d^l + 0{C^), (3.6) 

Mo = tanh/3/i2d, (3.7) 
2 tanh/3/i2d-2 - tanh/3/i2d 1 - tanh^ /3/i2d A 

Ml = t o lot r5 . (o.ol 

1 + ^2 tanh^ + 2t tanh fih tanh /3/i2d-2 1 - tanh^ I3h B ^ 

By taking the H ^ hmit, we can compute the zero field susceptibihty defined by 



M = xH + 0{H^). This admits the expansion X = Xo + Xi + 0{C^), 



where 

We are left with the task of computing the parameter C = Yl(p.v) ^Ihi^- We will 
follow the strategy 1 described in the previous Section. By differentiating the Bethe 
equations, we get 

dh^_ 1-tanh^ ^ dh^:l 

Using the fluctuation-dissipation relation (|2.21() and translation invariance, we get the 
following equation for the cavity correlations 

cfl^ = q5.,-, + r Cfi,- (3-11) 
,.l-tanh^,5., .._j-L-^. (3.12) 
These equations are easily solved by introducing the Fourier transform 

c;^\p) = E ^^"'^S ' = / (S^ ^^^p^ ' (^-^^^ 

where the integral over p runs over the Brillouin zone [— 7r,7r]'^. We obtain 

g(e«PM - r) 

^^^^^ ^ 1 - 2dr + (2d - ly + rp^ ' ^^'^^^ 

where p^ = 2d — e*^^. Therefore the correlation parameter entering in the correc- 
tions to BA is 

g I (l-^')g [ d'^P 1 fo-,.^ 

2r2 ^ 2r2 J {2tiY 1 - 2dr + {2d - l)r2 + rp2 ' ^ ^ 

A simple application of the above calculation consists in computing the critical 
temperature. We can do this by solving the equation x~^ = 0) which to this order 
implies 

1 - (2(i- l)tanh2/3^ + 2tanh2/3c(l -tanh/?c)C = 0, (3.16) 



10 



3 


0.221654(6) [13] 


0.237708 


0.207407 


4 


0.1497t [14] 


0.151650 


0.145833 


5 


0.11388(3) [15] 


0.114356 


0.112592 


6 


* 


0.092446 


0.091750 



Table 1: Critical temperature for the Ising model on d-dimensional cubic lattices as de- 
termined by numerical simulations, the new expansion presented in this paper, and second 
order 1/d expansion. The numerical result for d = 4 is quoted in Ref. [14] without statisti- 
cal errors. A more accurate estimate (3c = 0.14966(3) was obtained from high temperature 
expansion in Ref. [16]. 



By solving this equation to the first order in C, we get 

1 2d -2 



tanh Pc 



2d - 1 {2d- 1)3 



{2d - 1) - 2d{2d - 2)Id 



{2ttY p2 7o 



(3.17) 
(3.18) 



where /o( • ) is the Bessel function. The integral is convergent for d > 2. A numerical 
calculation of Id yields the values of (5c reported in Table ^ This is compared with 
numerical simulations and with the second order 1/d expansion 



Hi" 



1 



2d -I 



1 + 5^ + 0(0 



(3.19) 



We can also derive the critical behavior of the susceptibility. From Eq. (|3.9|) we get 

(5X-^ = K{(5c-(3)+ 0{{(3c - (3?) where 



K = 2d 



2d M{2d - 2) (2^2 -d+l) U\2d-2f ^ ^^^^^^ 



2d -I 



(2d -1)2 (2d -1)2 

The integral Jd is infrared divergent for d < 4. We have therefore rederived the well 
known upper-critical dimension d^p = 4. 



3.2 Spin glass on random graphs 

We consider here the case in which Q is an Erdos-Renyi random graph with vertices 
and average connectivity 7. Such a graph is constructed by drawing an edge between 
any couple (i, j) of distinct vertices independently with probability "f/N. Spins joined 
by an edge interact via a coupling Jij which are i.i.d. symmetric random variables 
with probability density function p{J) = p{ — J). This is also known as the Viana-Bray 
model and was first studied in Ref. [17]. In the following E will denote expectation 
with respect to the couplings and/or the graph realization. Finally we shall focus on 
the case of vanishing external field Hi = 0. 
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The interest of such a simple model is that it can be easily treated by the replica 
method, thus providing an useful check of our approach.^ Before applying the strategy 
outlined in the previous Section, let us briefly recall the replica results. Averaging 
over disorder, one gets the following representation for the moments of the partition 
function [20] 



E 



Z"" = J exp{-NS[c]}Vc, (3.22) 



where c{a) = c{(7^, . . . , o""), a"" € {±1} is the replica order parameter. The integral is 
then evaluated using the saddle point method, the paramagnetic saddle point being 
c(a) = 1/2"'. The free energy density /3/iv(/3) = — (1/A^)E log^Ar is then obtained by 
taking the n ^ limit: 

P/nW) = -log2-|Elogcosh/3J + l/3/W+0(iV-2), (3.23) 
^/W = -l72Elogcosh/3J+ ^72Elogcosh/3(Ji + J2) (3.24) 

k=l i=l 

Here expectations arc taken with respect to the Ji, J2, . . . which arc i.i.d. with dis- 
tribution p{J). The 0{1/N) term is the contribution of Gaussian fluctuations around 
this saddle point. As expected, it diverges upon approaching the spin glass critical 
temperature /3c (defined by 7E tanh^ PcJ = !)• More precisely we have 

/W(/3) = -ilog(/3e-/?) + 0(l). (3.25) 

We shall now rederive the above results by using the approach outlined in the 

previous Section. A serious shortcoming of this approach is that it does not provide an 
explicit expression for the free energy. One can circumvent this problem by considering 
the internal energy density un{(3) = KE{a)/N. Since all the edges of the graph are 
equivalent, 

AT- 1 

unW) = -^^7E{Jy(aia,) | (i, j) G G} . (3.26) 

Here E{ • | G G} denotes expectation conditional to the edge belonging to 

the graph Q. Consider now a particular graph G in which the link is present. It 
is simple to show that 

(aiaj) = Uj + (1 - 4) , (3.27) 

where C^j''^ denotes the correlation {aiUj) after link (i,j) has been removed (notice 
that local magnetizations (cTj) vanish by symmetry), and tij = tanh /3Jjj. Notice that 
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Some of the properties of the high temperature phase can be furthermore derived rigorously, see 



For ideas on 1/A'" corrections in the low temperature phase see [19]. 
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sampling Q under the condition € Q, and then removing is equivalent (fro 

the Erdos-Renyi ensemble) to sampling Q under the condition ^ Q- Substituting 
in Eq. (|3^ . we get 

^NiP) = -^^nJtj} - ^ 7E I J(l - t'j) ^ ^l^^,^ I , (3.28) 

where we used the shorthand tj = tanh [3 J. The second term vanishes as ^ oo, 
since it behaves as the correlation between two uniformly random sites in the system. 
We will therefore estimate it to the leading non-trivial order. Moreover, we can 
expand (1 + t j Cij)~^ in an absolutely convergent series to get 

njv(/3) = -|E{Jtj} + l|E{Jtj}- 

oo 

- I ^ (-1)^= E{J(1 - t])t'}} E{C7^i| (i, i) ^g} + 0{N~') , (3.29) 

fc=0 

where we factorized the expectation thanks to the fact that Q does not contain 
and therefore Cij is independent of J. 

We are left with the task of computing the moments of Cij. According to our 

general strategy, we use the identity Cij = ^ |^ ^ . It is well known [11] that, 

for the Erdos-Renyi random graph, Mi = tanh/?/ip^ up to corrections vanishing as 
N oo (here = denoted equality in distribution). Furthermore, by differentiating 



Bethe equations p.2|) we get 



dH ^'^^ ^ tanhpju^. (3.30) 

l(idi\m 

By averaging over the graph and couplings and recalling that the degree of a site 
is, for large A^, a Poisson random variable of mean 7, we obtain (here we use the 
shorthand dj for partial derivative with respect to Hj): 

^{(5,4'"^)'} = ^ + int':j}^[[d,hf^)']+0{N-^). (3.31) 

Moreover if we condition on i, j being distinct and not connected by an edge, the 
term 5ij in Eq. (|3.3U|1 is surely missing for at least two iterations, leading to 



E<! [d.hf'^^^ 



By solving these equations and identifying E{Cj^~''^| ^ G} with the left hand side 
of the last equation, we finally get 

E{Cf, | (i, j) ^G} = - ^ ■^/i, + 0{N-^) , (3.33) 

for k even (for k odd the expectation vanishes by symmetry. We can now plug this 
into Eq. 1)3. 29|) to get the final result 

un{P) = -^E{Jtj} + ln«(/3)+0(7V-2), (3.34) 

k odd 7 1 J J 
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One can then compute the free energy density by integrating over the temperature 
with boundary condition (3f]\f{f3) — log 2 as /3 ^ 0. It is easy to check that the 
resulting expression coincides with the replica result (|3.23|) , (|3.24|) . 

One surprising feature of the above calculation is the behavior of correlations. One 
would naively assume that the correlation between two random spins is concentrated 
around a typical value of order A^"*^, with 6 > 0, leading to EjC^^} ~ N"^^, in 
contradiction with the correct result, Eq. (|3.33j) . It is therefore interesting to study 
the distribution of Cij. For the sake of simplicity we shall admit the cases i = j 
and € Q which where excluded in the above calculation. In the N ^ oo limit, 
the correlations satisfy the same distributional equation as the response functions, 
cf. Eq (jOn|) : 

k 

C = ^{tanhpJi)Ci. (3.36) 

1=1 

Here A: is a Poisson random variable of mean 7 and Jj are i.i.d. with distribution 
P(J). Notice that this equation can only fix the distribution of C, to be denoted by 
p(C), up to a scaling factor. In fact, if C is a random variable satisfying the above 
equation, also aC does. We shall therefore write p{C) = (l/Co)/0*(C/Co), where the 
solution p*{C) is fixed arbitrarily and Co = Co{N) is the typical scale of correlations 
in a system of size A^. The scale Co will be determined by a matching procedure. 

Consider the characteristic function (j){s) = j exp(isC) d/9*(C). This satisfies the 
equation 

0(s) =exp{-7[l-E</.(ts)]}, (3.37) 

where expectation is taken with respect to t = tanh /? J. From this is easy to derive 
the small s behavior (/>(s) ~ 1 — 0o|'S|" where we can fix the freedom in the scale of C 
by setting cpo = 1. The exponent a is determined by 

7E{|tanh/3J|"} = 1. (3.38) 

Therefore a grows monotonously with /3 and takes the value a = 2 at /? = /?c. The 
large C behavior of the correlations distribution is p*{C) ~ (;^r(l+a) sin(^))|C|~^~". 
The physical reason of this power law tail is easily understood. Consider the neigh- 
borhood of a site i. Asymptotically, this will be a random tree with Poisson degree 
distribution (a Galton- Watson tree). For a site j at distance r from i, we have 
Cij = tanh pji ■ ■ ■ tanh PJ^, where Ji, . . . , Jr are the couplings on the path joining i 
to j. If we only consider these sites and sum over all finite r as A^ — > 00, we get 

PneighiC) = ^Y.^^ sic - fltanhp jA . (3.39) 

r=0 V i=l J 

The small C asymptotics of this distribution is p'^'^^^^{C) ~ Pq'^^^^ |C|^^~". By 
computing /9q°'^'^ and matching this behavior with the large C behavior of p{C) = 
(l/Co)/J*(C/Co), we determine 
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where tj = tanh /3J. As the temperature decreases from co to the critical temper- 
ature, a increases from to 2 and therefore the typical correlation scale increases 
from N~°° to N~^^'^. However, correlations are never concentrated around a partic- 
ular value but have a power-law behavior at all temperature. Integer moments are 
therefore governed by the largest correlations in the system (in particular they are 
ruled by p^'^^^^{C)) and are always of order A^~^. Finally notice that, because of the 
power-law behavior, there is no definite loop length responsible for corrections to BA. 

Let us conclude with a comment. One could have been skeptical about the success 
of the present approach in computing effects in for spin models on random graphs. 
In fact, an average fraction of spins of such systems lies in a neighborhood of 
finite-size loops (e.g. triangles). For such spins the violation of BA is non-perturbative 
and our approach could have seemed a priori hopeless. However, the exactness of our 
method for uni-cyclic graph allows to overcome this problem. On the other hand, it 
was crucial not to neglect terms of order E {C^j^^}, k > in Eq. (|3.29j) . i.e. to follow 
the procedure 2 described in Section [3 

The same kind of argument suggest that the systematic expansion described in 
Section [21 corresponds in fact to the expansion for random graphs. The next 
correction is due to couples of joined closed loops, an event occurring in average near 
a fraction of the sites. 
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